User interface system and method

ABSTRACT

The user interface system of the preferred embodiments includes a layer defining a tactile surface and including a first region and a particular region adjacent the first region; a substrate defining a fluid channel, cooperating with the layer at the particular region to define a cavity fluidly coupled to the fluid channel, coupled to the layer at the first region; a displacement device displacing fluid into the fluid channel into the cavity to transition the particular region from a retracted volume setting into an expanded volume setting, the particular region substantially level with the first region in the retracted volume setting and elevated above the first region in the expanded volume setting; and a sensor including a first conductor and a second conductor coupled to the substrate and adjacent the cavity, the first conductor offset from the second conductor and capacitively coupled to the second conductor.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of prior U.S. application Ser. No.13/456,010, filed on 25 Apr. 2012, which is a continuation of U.S.application Ser. No. 12/497,622, filed on 3 Jul. 2009, which is acontinuation-in-part of prior U.S. application Ser. No. 12/319,334,filed on 5 Jan. 2009, which is a continuation-in-part of prior U.S.application Ser. No. 11/969,848, filed on 4 Jan. 2008, all of which areincorporated in their entirety by this reference. U.S. application Ser.No. 12/497,622 is also a continuation-in-part of prior U.S. applicationSer. No. 11/969,848, filed on 4 Jan. 2008.

This application is also a continuation-in-part of prior U.S.application Ser. No. 13/414,589, filed on 7 Mar. 2012, which is acontinuation of U.S. application Ser. No. 12/319,334, filed on 5 Jan.2009, which is a continuation-in-part of prior U.S. application Ser. No.11/969,848, filed on 4 Jan. 2008, all of which are incorporated in theirentirety by this reference.

This application is also a continuation-in-part of prior U.S.application Ser. No. 11/969,848, filed on 4 Jan. 2008, which isincorporated in its entirety by this reference.

BACKGROUND

Static user input interfaces, such as those on a typical televisionremote control or on a mobile phone, provide users with one userinterface that locks the interaction modes available between the deviceand the user. Devices with a static user input interface that may beused with a variety of applications also become very complicated becausethe static user input interface must be compatible with eachapplication. In the case of universal remotes, user interaction maybecome very confusing for the user because of the abundance of buttonsavailable that may either provide dual functionality between devices orare extraneous for any one particular device. In the case of mobiledevices, such as a cellular phone with multiple functionalities thatuses a static user input interface, adapting the available static userinput interface to the plurality of functionalities of the device isalso challenging. Additionally, as mobile devices become smaller andmore powerful, functionality of the device may be severely hindered by astatic user input interface.

Touch sensitive displays, e.g., touch screens, are able to provide adynamic user input interface and are very useful in applications wherethe user interface is applied to a variety of uses, for example, in auniversal remote where the user interface may change to adapt to thedevice that is being controlled by the user or in a cellular phone withmultiple functionalities. However, unlike a static user input interfacewith a dedicated input device, such as a keypad with discretewell-defined keys, most touch sensitive displays are generally flat. Asa result, touch sensitive displays do not provide any of the tactileguidance that may be seen in static user interfaces.

Hence, serious drawbacks exist in current commonly available userinterfaces. In the case of a static user input interface, there is thebenefit of tactile guidance but the serious drawback of inability toadapt to an application type. In the case of a touch sensitive display,there is the benefit of an adaptable display and dynamic user inputinterface but the serious drawback of no tactile guidance, resulting inincorrectly entered keystrokes and the need for the user to keep his orher eyes on the display. The importance of tactile guidance is readilyapparent in the competition between the Apple iPhone and the Blackberry8800. Additionally, with many touch sensitive displays, each touch madeby the user is registered with the system, preventing the user fromresting his or her finger on the surface of the display. In some touchsensitive displays, the reliance on the change in capacitance due to thepresence of a finger at a location as the occurrence of a user inputresults in the inability for the touch sensitive display to detect userinputs when the user is wearing a glove or when other barriers between afinger and the screen are present.

This invention provides a new and useful user interface that combinesmany of the advantages of the benefits of a static user input interfaceand many of the advantages of a dynamic user input interface.

BRIEF DESCRIPTION OF THE FIGURES

FIGS. 1a and 1b are a top view of the user interface system of apreferred embodiments and a cross-sectional view illustrating theoperation of a button array in accordance to the preferred embodiments,respectively.

FIGS. 2a, 2b, and 2c are cross-sectional views of the retracted,extended, and user input modes of the preferred embodiments,respectively.

FIG. 3 is a cross-sectional view of the sheet, the cavity, the sensor,and the display of the preferred embodiments.

FIG. 4 is a cross-sectional view of the sheet split into a layer portionand a substrate portion.

FIGS. 5a and 5b are cross-sectional views of the sheet, the cavity, thesensor, and a displacement device that modifies the existing fluid inthe cavity, with the cavity in a retracted volume setting and anexpanded volume setting, respectively.

FIG. 6 is a schematic view of the sheet, the cavity, the sensor, and adisplacement device of a first example that displaces additional fluidinto the cavity.

FIG. 7 is a schematic view of the sheet, the cavity, the sensor, and adisplacement device of a second example that displaces additional fluidinto the cavity.

FIGS. 8a and 8b are schematic views of the sheet, the cavity, thesensor, and a displacement device of a third example that displacesadditional fluid into and out of the cavity, with the cavity in aretracted volume setting and an expanded volume setting, respectively.

FIGS. 9, 10, 11, and 12 are top and side views of a button deformation,a slider deformation, a slider ring deformation, a guide deformation,and a pointing stick deformation, respectively.

FIG. 13 is a cross-sectional view of a variation of the preferredembodiments with a support structure and a sensor that detects usertouch through the support structure.

FIGS. 14a, 14b, 14c, and 14d are schematic views of a first, second,third, and fourth example of a first variation of the sensor as acapacitive sensor, respectively.

FIGS. 15a and 15b are schematic representations of a first and secondmethod of measuring capacitance of a first variation of the sensor as acapacitive sensor, respectively.

FIGS. 16a, 16b, and 16c are schematic views of a first, second, andthird example of the placement of the conductors of the sensor as acapacitive sensor, respectively.

FIGS. 17a and 17b are schematic views of a first and second example of asecond variation of the sensor as a capacitive sensor, respectively.

FIGS. 18a-18e are schematic representations of a variety of geometriesfor the sensor as a capacitive sensor.

FIGS. 19a and 19b are schematic views of a first and second variation ofthe sensor as a pressure sensor, respectively.

FIG. 20 is a flow chart of the different operation modes of thepreferred embodiments.

FIG. 21 is a schematic of the different input graphics, different cavitysettings, and different user touches of the preferred embodiments.

FIG. 22 is a top view of the sensor that is a capacitive sensor with anX-conductor and a Y-conductor per cavity.

FIG. 23 is a top view of the sensor that is a capacitive sensor withfewer than an X-conductor and a Y-conductor per cavity.

FIGS. 24a and 24b are cross-sectional views of a support member betweenthe layer and the substrate, with the cavity in a retracted volumesetting and an expanded volume setting, respectively.

FIG. 24c is a top view of the support member.

FIG. 24d is a cross-sectional view of an alternative support member thatpartially defines the cavity.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The following description of the preferred embodiments of the inventionis not intended to limit the invention to these preferred embodiments,but rather to enable any person skilled in the art to make and use thisinvention.

As shown in FIGS. 1 and 2, the user interface system 100 of thepreferred embodiments includes a sheet 110 that defines a surface 115and a cavity 125, a volume of a fluid 120 contained within the cavity125, a displacement device 130 that modifies the volume of the fluid 120to expand the cavity 125 (thereby outwardly deforming a particularregion 113 of the surface 115), and a sensor 140 that detects a forceapplied by a user that inwardly deforms the particular region 113 of thesurface 115. As shown in FIG. 3, the user interface system 100 may alsoinclude a display 150 coupled to the sheet 110 and adapted to outputimages to the user and a processor 160 that is preferably coupled to thesensor 140 to receive signals from the sensor 140 and coupled to thedisplacement device 130 to send signals to the displacement device 130.The sensor 140 may also be located in between the sheet 110 and thedisplay 150. However, any other suitable arrangement of the componentsof the system 100 may be used.

The user interface system 100 of the preferred embodiments has beenspecifically designed to be used as the user interface for an electronicdevice, more preferably in an electronic device that benefits from anadaptive user interface. The electronic device, which may or may notinclude a display, may be an automotive console, a desktop computer, alaptop computer, a tablet computer, a television, a radio, a desk phone,a mobile phone, a PDA, a personal navigation device, a personal mediaplayer, a camera, a watch, a remote, a mouse, a trackpad, or a keyboard.The user interface system 100 may, however, be used as the userinterface for any suitable device that interfaces with a user in atactile and/or visual manner. As shown in FIG. 2, the surface 115 of theuser interface system 100 preferably remains flat until a tactileguidance is to be provided at the location of the particular region 113.The surface 115 of the user interface system 100 may also be deformedwhen a user input is required. At that time, the displacement device 130expands the cavity 125 to deform and/or expand the particular region 113outward, preferably forming a button-like shape. With the button-likeshape, the user will have tactile guidance when navigating for theexpanded particular region 113 and will have tactile feedback whenapplying force onto the particular region 113 to provide input. Thesensor 140 preferably senses the force that inwardly deforms theparticular region 113. However, any other arrangement of the userinterface system 100 suitable to providing tactile guidance and/ordetecting user input may be used.

1. The Sheet

As shown in FIGS. 1 and 2, the sheet 110 of the preferred embodimentfunctions to provide the surface 115 that interfaces with a user in atactile manner and to at least partially define the cavity 125. Thesurface 115 is preferably continuous, such that when swiping a fingeracross the surface 115 a user would not feel any interruptions or seams.Alternatively, the surface 115 may include features that facilitate theuser in distinguishing one region from another. The surface 115 is alsopreferably planar. The surface 115 is preferably arranged in a flatplane, but may alternatively be arranged in a curved or warped plane.The surface 115 also functions to deform upon an expansion of the cavity125, and to preferably “relax” or “un-deform” back to a normal planarstate upon retraction of the cavity 125. In one version, the sheet 110contains a first portion that is elastic and a second portion that isrelatively less elastic. In another version, sheet 110 is relativelymore elastic in specific areas and relatively less elastic in otherareas and is deformed by the expanded cavity 125 in the relatively moreelastic areas. In another version, the sheet 110 is generally of thesame elasticity. In yet another version, the sheet 110 includes or ismade of a smart material, such as Nickel Titanium (commonly referred toas “Nitinol”), that has a selective and/or variable elasticity. Thesheet 110 is preferably optically transparent, but may alternatively betranslucent or opaque. In addition to the transparency, the sheet 110preferably has the following properties: a high transmission, a lowhaze, a wide viewing angle, a minimal amount of back reflectance uponthe display (if the display is included with the user interface system100), scratch resistant, chemical resistant, stain resistant, relativelysmooth (not tacky) to the touch, no out-gassing, and/or relatively lowdegradation rate when exposed to ultraviolet light. The sheet 110 ispreferably made from a suitable elastic material, including polymers andsilicon-based elastomers such as poly-dimethylsiloxane (PDMS) or RTVSilicon (e.g., RTV Silicon 615). In the version wherein the sheet 110includes a first portion that is elastic and a second portion that isrelatively inelastic, the inelastic portion is preferably made from amaterial including polymers or glass, for example, elastomers,silicon-based organic polymers such as poly-dimethylsiloxane (PDMS),thermoset plastics such as polymethyl methacrylate (PMMA), photocurablesolvent resistant elastomers such as perfluropolyethers, polyethyleneterephthalate (PET), or any other suitable material. The sheet 110 may,however, be made of any suitable material that provides the surface 115that deforms and defines a cavity 125. The sheet 110 may be manufacturedusing well-known techniques for micro-fluid arrays to create one or morecavities and/or micro channels. The sheet 110 may be constructed usingmultiple layers from the same material or from different suitablematerials, for example, the sheet 110 may include a layer portion 116 ofone material that defines the surface 115 and a substrate portion 118 ofa second material (as shown in FIG. 4). The substrate portion 118functions to support the layer portion 118 and to at least partiallydefine the cavity 125. However, any other suitable arrangement,material, and manufacturing method may be used to create sheet 110.

As shown in FIGS. 24a and 24b , the substrate 120 may include alattice-like support member 112 under the particular region of thesurface 115. When the cavity 125 is expanded and the deformation ispresent in the surface 115, the support member 112 functions to preventa user from “pressing too far” into the deformation below the plane ofthe surface 115. When the cavity 125 is not expanded and the deformationis not present in the surface 115, the support member 112 functions toreduce (or potentially eliminate) the user from feeling “divots” in thesurface 115 when swiping a finger across the surface 115. As shown inFIG. 24c , the support member 112 preferably includes holes or channelsthat allow for the expansion of the cavity 125 and the deformation ofthe surface 115. The support member 112 is preferably integrally formedwith the substrate 124, but may alternatively be formed with the layer110 or may be separately formed and later attached to the substrate 120.Finally, as shown in FIG. 24d , the support member 112 may alternativelypartially define the cavity 125. The substrate 120 is preferably rigid,but may alternatively be flexible in one or more directions. Thesubstrate 120—if located above the display 150—is preferably opticallytransparent, but may—if located below the display 150 or if bundledwithout a display 150—be translucent or opaque. The substrate 120 ispreferably made from a material including polymers or glass, forexample, elastomers, silicon-based organic polymers such aspoly-dimethylsiloxane (PDMS), thermoset plastics such as polymethylmethacrylate (PMMA), and photocurable solvent resistant elastomers suchas perfluropolyethers. The substrate 120 may, however, be made of anysuitable material that supports the layer 110 and at least partiallydefines the cavity 125. In the preferred version, the substrate 120 is asingle homogenous layer approximately 1 mm to 0.1 mm thick and can bemanufactured using well-known techniques for micro-fluid arrays tocreate one or more cavities and/or micro channels. In alternativeversions, the substrate 120 may be constructed using multiple layersfrom the same material or from different suitable materials.

As shown in FIG. 2, the cavity 125 of the preferred embodiment functionsto hold a volume of fluid 120 and to have at least two volumetricsettings: a retracted volume setting (shown in FIG. 2a ) and an extendedvolume setting (shown in FIG. 2b ). The fluid 120 is preferably asubstantially incompressible fluid, but may alternatively be acompressible fluid. The fluid 120 is preferably a liquid (such as water,glycerin, or ethylene glycol), but may alternatively be a gas (such asair, nitrogen, or argon) or any other substance (such as a gel oraerogel) that expands the cavity 125 and deforms the surface 115. In theextended volume setting, the cavity 125 deforms the particular region113 of the surface 115 above the plane of the other regions of thesurface 115. When used with a mobile phone device, the cavity 125preferably has a diameter of 2-10 mm. When used with this or otherapplications, however, the cavity 125 may have any suitable dimension.

2. The Displacement Device

The displacement device 130 of the preferred embodiment functions toinfluence the volume of the fluid 120 to expand the cavity 125 from theretracted volume setting to the extended volume setting and, ultimately,deforming a particular region 113 of the surface 115. The displacementdevice 130 preferably modifies the volume of the fluid 120 by (1)modifying the volume of the existing fluid in the cavity 125, or (2)adding and removing fluid to and from the cavity 125. The displacementdevice 130 may, however, influence the volume of the fluid 120 by anysuitable device or method. Modifying the volume of the existing fluid inthe cavity 125 most likely has an advantage of lesser complexity, whileadding and removing fluid to and from the cavity 125 most likely has anadvantage of maintaining the deformation of the surface 115 without theneed for additional energy (if valves or other lockable mechanisms areused). When used with a mobile phone device, the displacement device 130preferably increases the volume of the fluid 120 within the cavity 125by approximately 0.003-0.1 ml. When used with this or otherapplications, however, the volume of the fluid may be increased (orpossibly decreased) by any suitable amount.

Modifying the existing fluid in the cavity 125 may be accomplished inseveral ways. In a first example, as shown in FIGS. 5a and 5b , thefluid may be an expandable fluid and the displacement device 130 mayinclude a heating element that heats the expandable fluid, therebyexpanding the volume of the existing fluid in the cavity 125 (accordingto the ideal gas law, PV=nRT). The heating element, which may be locatedwithin, adjacent the cavity 125, or any other location suitable toproviding heat to the fluid, is preferably a resistive heater (made of amaterial such as TaN or Nichrome). In a second example, the fluid mayinclude an expandable substance, such as plastic expandablemicrospheres. In a third example, the fluid may include paraffin. Whilethese are three examples, the displacement device 130 can be any othersuitable device or method that ultimately expands the cavity 125 fromthe retracted volume setting to the extended volume setting by modifyingthe existing fluid in the cavity 125.

Adding and removing fluid to and from the cavity 125 may also beaccomplished in several ways. In a first example, as shown in FIG. 6,the displacement device 130 includes a reservoir 132 to hold additionalfluid and a pump 134 to displace fluid from the reservoir 132 to thecavity 125. The reservoir 132 is preferably remote from the cavity 125(and connected by a channel 138 or other suitable device), but mayalternatively be located adjacent the cavity 125 and connected directlyto the cavity 125. A portion of the channel 138 is preferably amicro-fluidic channel (having cross-section dimensions in the range of 1micrometer to 1000 micrometers), but depending on the size and costsconstraints of the user interface system 100, the channel 138 may haveany suitable dimensions. The pump 134 is preferably a micro-pump (suchas pump #MDP2205 from ThinXXS Microtechnology AG of Zweibrucken, Germanyor pump #mp5 from Bartels Mikrotechnik GmbH of Dortmund, Germany), butmay be any suitable device to pump fluid from one location to another.The pump 134 is preferably located at a distance from the cavity 125,and is preferably connected to the cavity 125 by a channel 138. Toextend the cavity 125 from a retracted volume setting to the extendedvolume setting, the pump 134 displaces fluid from a reservoir 132,through the channel 138, and into the cavity 125. To retract the cavity125 from the extended volume setting to the retracted volume setting,the pump 134 preferably “vents” or pumps in a reverse direction from thecavity 125 to the reservoir 132. In a second example, as shown in FIG.7, the displacement device 130 includes a reservoir 132 to holdadditional fluid, a first pump 134 to displace fluid from the reservoir132 to the cavity 125, a second pump 136 to displace fluid from thecavity 125 to the reservoir 132, a first valve located between the firstpump 134 and the cavity 125, and a second valve located between thecavity 125 and the second pump 136. To extend the cavity 125 from theretracted volume setting to the extended volume setting, the first valveis opened, the second valve is closed, and the first pump 134 displacesfluid from the reservoir 132, through the channel 138, and into thecavity 125. To retract the cavity 125 from the extended position to theretracted position, the first valve is closed, the second valve isopened, and the second pump 136 displaces fluid from the cavity 125,through the channel 138, and into the reservoir 132. In other respects,the second example is similar to the first example above. The userinterface system 100 may omit the second pump 136 and simply retract thecavity 125 from the extended volume setting to the retracted volumesetting by opening the second valve and allowing the cavity 125 to ventor “drain” into the reservoir 132 (potentially assisted by theelasticity of the sheet 110 returning to an un-deformed state). In athird example, as shown in FIGS. 8a and 8b , the displacement device 130includes an actuator, such as a linear actuator, that displaces fluidinto and out of the cavity 125. To extend the cavity 125 from aretracted volume setting to the extended volume setting, as shown inFIG. 8a , the linear actuator displaces fluid through the channel 138and into the cavity 125. To retract the cavity 125 from the extendedvolume setting to the retracted volume setting, as shown in FIG. 8b ,the linear actuator draws fluid in a reverse direction from the cavity125 to the reservoir 132. In other respects, the third example issimilar to the second example above. While these are three examples, thedisplacement device 130 can be any other suitable device or method thatultimately expands the cavity 125 from the retracted volume setting tothe extended volume setting by adding and removing fluid to and from thecavity 125.

Although the cause of the deformation of a particular region 113 of thesurface 115 has been described as a modification of the volume of thefluid in the cavity 125, it is possible to describe the cause of thedeformation as an increase in the pressure below the surface 115relative to the pressure above the surface 115. When used with a mobilephone device, an increase of approximately 0.1-10.0 psi between thepressure below the sheet 110 relative to the pressure above the sheet110, is preferably enough to deform a particular region 113 of thesurface 115. When used with this or other applications, however, themodification of the pressure may be increased (or possibly decreased) byany suitable amount.

3. The Deformation of the Surface and the Sensor

The deformation of the particular region 113 functions to providetactile feedback and tactile guidance on the surface 115 for the user.The deformation of the particular region 113 also preferably functionsto inform the user of the type of input the deformation represents. Forexample, the deformation of the particular region 113 may be of a shapethat indicates the type of input that the deformation represents. Forexample, a circular deformation may indicate to the user that they areto select an area along the circular deformation. Alternatively, thesheet 110 may include tactile instructions, for example, a pattern ofbeads on the particular region 113 that indicate the type of input thedeformation represents, for example, a deformation may have a tactilepattern of beads that indicate an arrow, informing the user that thedeformation is for a directional input. The tactile instructions on theparticular region 113 may alternatively be any other type of featurethat is able to be felt tactilely by the user. The sheet 110 of the userinterface 100 may also be coupled to a graphic (e.g, a paper insert, aphoto, etc.) to indicate to the user the input that is associated withdepressing the deformed particular region 113. When used in conjunctionwith the display 150, the user is preferably shown at least one imagethat is an image of a visual guide or an input key that is substantiallyaligned with the particular region 113. The display 150 may also displayat least two images, with at least one image substantially aligned withthe particular region 113 and functioning to visually differentiate theparticular region 113 from the rest of the surface 115 and indicating avisual guide or an input key that the deformed particular region 113represents. From the user's perspective, the device is asking for a userinput through the display 150 and the user interface system 110 isproviding tactile guidance and tactile feedback when the user indicatesthe desired input. The two images may alternatively include a firstimage and a second image. The first image is displayed and substantiallyaligned with the particular region 113 and then the second image isdisplayed and substantially aligned with the particular region 113 whenthe first image is removed. However, any other arrangement of the userinterface system 100 suitable to interfacing with the user may be used.

The deformation preferably acts as (1) a button that, when pressed bythe user, signals an input to the sensor 140 (2) a slider that may bepressed at multiple points along the deformation by the user and thatsignals the location of multiple inputs on the sensor 140, and/or (3) apointing stick that signals the location of multiple inputs on sensor140. The deformation may, however, act as any other suitable device ormethod that signals a user input to the sensor 140. The button, as shownin FIG. 9, preferably has a dome-like shape, but may alternatively havea cylindrical-like shape (with a flat top surface), a pyramid-likeshape, a cube-like shape (with a flat top), or any other suitable buttonshape. The sensor 140 preferably recognizes any user touch 145 into thebutton as a user input. The slider, as shown in FIGS. 10 and 11,preferably has a ridge like shape (shown in FIG. 10), but mayalternatively have a ring like shape (shown in FIG. 11), a plus-likeshape, or any other suitable slider shape. The sensor 140 preferablyrecognizes user touches 145 at different locations into the slider anddistinguishes these user touches as different user inputs. As anexample, the slider with the ring like shape may act like the “clickwheel” of the Apple iPod (second generation). The pointing stick, likethe button, preferably has a dome-like shape, as shown in FIG. 12, butmay alternatively have a cylindrical-like shape (with a flat topsurface), a pyramid-like shape, a cube-like shape (with a flat top), orany other suitable button shape. The sensor 140 preferably recognizesuser touches 145 at different locations along the pointing stick anddistinguishes these user touches as different user inputs. A depressionfrom the force applied by the user on a portion of the pointing stick ismeant to signal a user input in the location of the depression relativeto the geometry of the pointing stick. For example, in the variationwherein the pointing stick is a dome-like shape, a depression by theuser in the upper right quadrant will be interpreted differently than adepression by the user in the lower right quadrant. Additionally, theuser may depress the pointing stick in a sweeping motion, for example, a“sweep” from the upper right quadrant to the lower right quadrant. Thismay be interpreted as a moving input, similar to that seen in the “clickwheel” of the Apple iPod (second generation). In another example, thepoint stick may act like the pointing stick trademarked by IBM as theTRACKPOINT and by Synaptics as the TOUCHSTYK (which are both informallyknown as the “nipple”).

The sensor 140 may be located within the cavity 125 and/or adjacent tothe cavity 125, but may alternatively be located in any other suitablelocation. In a variation of the sheet 110 and the cavity 125 thatincludes a support element 112 underneath the surface 115 for theparticular region 113 as shown in FIG. 13, a sensor 140 preferablyfunctions to sense a user input through the support element 112 from anylocation. The sensor 140 preferably detects the presence of a usertouch, an inward depression of the expanded particular region 113,and/or any other suitable user input. The sensor may 140 may alsofunction to detect the direction of the user input, the location of theuser input, the rate at which the user is inwardly deforming theexpanded particular region 113, the level to which the user is inwardlydeforming the expanded particular region 113, the type of user input(for example, input by finger or by stylus), and/or any other suitablecharacteristic of the user input.

The sensor 140 is preferably a capacitive sensor that includes at leasttwo conductors that detects a fluctuation in an electric field createdby the at least two conductors of the capacitive sensor. The fluctuationmay be caused by a user touch, user input through a stylus or any othersuitable input assist element, the deformation of the particular region113, change in fluid position/volume, or any other event that may causea fluctuation in the electric field that may result in a change in themeasured capacitance. The capacitive sensor and is preferably one ofseveral variations. In a first variation, the capacitive sensor includesa first conductor 142 and a second conductor that is a virtualconductor. For example, the virtual conductor may be the virtual ground(such as the shielding ground or the case ground) of the device that theuser interface system 100 is appended to, a screen ground for thedisplay 150, or, if the device is a cellular phone, the RF/Signal groundof the device. Fluctuations in the electric field generated between thefirst conductor 142 and the virtual ground may be used to detect thepresence of touch or an input. As shown in FIG. 14, the capacitivesensor is adapted to sense height changes of the fluid 120 within thecavity 125 and/or the presence of a finger on the deformed particularregion 113. As shown in FIG. 14a , the first conductor 142 is preferablyplaced in a location within or adjacent the cavity wherein the inwarddeformation of the particular region 113 will change the height of thefluid 120 relative to the first conductor 142, thereby influencing themeasured capacitance of the capacitive sensor. The first conductor 142is preferably located on the bottom side of the cavity opposite of thesurface 115, allowing the capacitive sensor to sense height changes ofthe fluid as the particular region 113 is inwardly deformed, but mayalternatively be located at the side of the cavity adjacent to thesurface 115. When placed adjacent to the surface 115, the firstconductor 142 preferably deforms with the particular surface 113 as theuser applies force to allow a change in the height of fluid 120 to besensed. The first conductor 142 may alternatively be placed in anysuitable location to allow changes in the height of fluid 120 due toinward deformation of the particular surface 113 to be sensed. The firstconductor 142 is preferably made of copper, micro or nanowire, or atransparent conductor such as sputtered indium tin oxide (ITO), but mayalternatively be of any type of conductive material wherein the measuredcapacitance of the conductor is sensitive to height changes of the fluid120. The capacitive sensor may also function to detect a capacitancechange relative to the surface 115 due to the presence of the finger ofthe user.

As shown in FIG. 14b , capacitive sensor of the first variation mayinclude a first conductor 142 and a second conductor 144 that is placedwithin the cavity 125. The second conductor 144 may be used measure thechange in capacitance in between the first conductor 142 and the secondconductor 144 as the user inwardly deforms the particular region 113.For example, as the user inwardly deforms the particular region 113, theamount of fluid 120 and/or the height of the fluid 120 in between thefirst conductor 142 and the second conductor 144 may change, causing achange in measured capacitance in between the first conductor 142 andthe second conductor 144. The gradient of height difference in betweenthe first conductor 142 and the second conductor 144 may also yield ameasurable change in the capacitance in between the first conductor 142and the second conductor 144. For example, the capacitance readingbetween the first conductor 142 and the second conductor 144 when theuser inwardly deforms the particular region 113 closer to the firstconductor 142 may be different from the capacitance reading between thefirst conductor 142 and the second conductor 144 when the user inwardlydeforms the particular region 113 closer to the second conductor 144.This difference may facilitate determining the location of the userinput relative to the geometry of the particular region 113.Alternatively, the second conductor 144 may be used to measure heightchanges of the fluid 120 in the region above the second conductor 144 towork in tandem with the first conductor 142 to provide a more localcapacitive measurement of height changes within the cavity 125.Measuring local capacitive changes within the cavity 125 also allows arelative height difference in the fluid 120 to be measured. For example,as the user inwardly deforms the particular region 113, the height ofthe fluid 120 over the first conductor 142 may be different from theheight of the fluid over the second conductor 144, resulting in adifference in the measured capacitance value of the first conductor 142and the measured capacitance value of the second conductor 144 relativeto the surface 115. The capacitance between the first conductor 142 anda first portion of the second conductor 144 may also be compared to thecapacitance between the first conductor 142 and a second portion of thesecond conductor 144 to determine the relative difference in the heightof the fluid 120. The relative difference in capacitive values betweenthe two conductors 142 and 144 may facilitate the determination of thelocation of the user input relative to the geometry of the particularregion 113. The first and second portions of the second conductor 144may be continuous sections along the second conductor 144, but mayalternatively be separated by a third portion of a different materialfrom the first and second portions or a break in the second conductor144. The second conductor 144 may include the first portion and alsoinclude a third conductor 146 that contains the second portion. However,any other suitable arrangement and method to determine the occurrenceand/or location of a user input through the conductors may be used. Thesecond conductor 144 is preferably identical to the first conductor 142in material and manufacturing, but may alternatively be made of anymaterial or method suitable to providing a capacitive relationship withthe first conductor 142.

As shown in FIG. 14c and FIG. 14d , the capacitive sensor of the firstvariation may also include a third conductor 146 and/or a fourthconductor 148. The addition of a third and/or fourth conductor 146 and148 allows for more accurate determination of the location of user inputrelative to the geometry of the particular region 113. For example, inthe case of four conductors, as shown in FIG. 14d , the particularregion 113 may be divided into a four quadrant coordinate system throughan X and Y axis with the origin substantially in the center of theparticular region 113. In this example, the location of the user inputrelative to the geometry of the particular region 113 may be measured ina variety of methods. In a first method, as shown in FIG. 15a , thecapacitance and/or the relative capacitance between the first conductor142 and the third conductor 146 may be measured to determine thelocation of the user input along the X-axis and the capacitance and/orthe relative capacitance between the second conductor 144 and the fourthconductor 148 may be measured to determine the location of the userinput along the Y-axis. The measured location along the X-axis and themeasured location along the Y-axis are then used to determine thelocation of the user input within the four quadrant coordinate system.In a second method, as shown in FIG. 15b , three capacitance and/orrelative capacitance values are measured: between the first conductor142 and the second conductor 144, between the first conductor 142 andthe third conductor 146, and between the first conductor 142 and thefourth conductor 148. The three capacitance values are then preferablyused to determine the location of the user input within a four quadrantcoordinate system (which can be superimposed over the “tridrant”coordinate system). Similarly, the same methods and/or relationships maybe applied to the case of three conductors or any other suitable numberof conductors. However, any suitable number of conductors and any othermethod or relationship between the conductors suitable to determine thelocation of the user input relative to the geometry of the particularregion 113 may be used. The third conductor 146, fourth conductor 148,and/or any other suitable number of conductors are preferably identicalto the first conductor 142 in material and manufacturing, but mayalternatively made of any material or method suitable to providing acapacitive relationship with the first conductor 142 and/or otherconductors.

As shown in FIG. 16a , the first conductor 142 is preferably placed at afirst level relative to the cavity and the second, third, fourthconductors 144, 146, 148, and/or any other suitable number of conductorsare placed at the same level relative to the cavity. Alternatively, asshown in FIG. 16b , the first conductor 142 may be placed at a firstlevel relative to the cavity and the second conductor 144 may be placedat a second level relative to the cavity. In this variation, the secondlevel is preferably higher than the first level, but may alternativelybe lower than the first level. The third, fourth conductors 146, 148and/or any other suitable number of conductors may also be placed at thesecond level, but may alternatively be located at a third and/or fourthlevel relative to the cavity. The difference in location placementrelative to the height level within the cavity may facilitate accuratemeasurement of the location of user input relative to the geometry ofthe particular region 113. Additionally, in the variation of the sheet115 wherein the sheet 115 includes a layer portion 116 and a substrateportion 118, the first conductor 142 may be coupled to the substrateportion 118 and the second conductor 144 may be coupled to the layerportion 116, as shown in FIG. 16c . However, any other combination ofplacement of the conductors of the capacitive sensor suitable todetermining the location of the user input relative to the geometry ofthe particular region 113 may be used.

As shown in FIGS. 17a and 17b , the capacitive sensor of the secondvariation preferably senses the change in height in between a firstconductor 142 and a second conductor 144. In this variation, the firstconductor 142 is preferably placed in a location that moves when theuser inwardly deforms the particular region 113 and the second conductor144 is preferably placed in a location that remains relativelystationary when the user inwardly deforms the particular region 113. Thesecond conductor 144 may be placed within the cavity 125, as shown inFIG. 17a , but may alternatively be placed in any relatively stationarylocation within the user interface system 100, as shown in FIG. 17b . Inthis arrangement, a change in the distance between the first and secondconductors 142 and 144 will cause the measured capacitance in betweenthe first and second conductors 142 and 144 to change, indicating a userinput. The first conductor 142 may also be a flexible conductor suchthat the inward deformation of the particular region 113 may cause thefirst conductor 142 to similarly deform. This may allow the location ofthe user input relative to the geometry of the particular region 113 tobe determined. For example, the capacitive sensor may also include athird conductor 146 and/or any suitable number of conductors that mayfacilitate accurately determining the location of the user inputrelative to the geometry of the particular region 113. The movement ofthe first conductor 142 may be detected by measuring the capacitivevalue between the first conductor 142 and the second conductor 144 andthe capacitive value between the first conductor 142 and the thirdconductor 146. The difference between the two capacitive values maybetter indicate the location of the user input relative to the geometryof the particular region 113. Alternatively, the capacitance between thefirst conductor 142 and a first portion of the second conductor 144 mayalso be compared to the capacitance between the first conductor 142 anda second portion of the second conductor 144 to determine the relativedifference in the height of the fluid 120. The relative difference incapacitive values between the two conductors 142 and 144 may facilitatethe determination of the location of the user input relative to thegeometry of the particular region 113. However, any other suitablearrangement and location of the conductors of the capacitive sensor ofthe second variation of the sensor 140 suitable to measuring distancedifferences between conductors due to inward deformation of theparticular region 113 by the user may be used. The conductors of thesecond variation are preferably identical to the first conductor 142 inthe first variation in material and manufacturing, but may alternativelymade of any material or method suitable to providing a capacitiverelationship indicating the distance between conductors.

As shown in FIG. 18, the conductors of the capacitive sensor variationof the sensor 140 may be any one of a variety of arrangements andgeometries. As mentioned above, both the first and second variations ofthe capacitive sensor may include at least two conductors (a firstconductor and a second conductor). As shown in FIG. 18a , the first andsecond conductors are preferably of the same shape within the cavity125. Alternatively, as shown in FIGS. 18b-18e , the first conductor maybe of a first geometry and the second conductor may be of a secondgeometry to increase accuracy in measuring changes in capacitance due toinward deformation of the particular region 113 by the user. Forexample, the second geometry may follow the geometry of the particularregion 113 to facilitate the detection of deformations of the particularregion 113, as shown in FIGS. 18b and 18c . The second conductor may beplaced substantially close to the perimeter of the particular region113, but may alternatively be placed substantially close to the centerof the particular region 113. However, the second conductor may beplaced in any location suitable to detecting the desired user inputs.Alternatively, as shown in FIGS. 18d and 18e , the second conductor maybe placed perpendicular to the first conductor to allow deformations tobe detected both along the axis of the first conductor and along theaxis of the second conductor, expanding the region of sensitivity.Additionally, the second conductor may contain more than one portionwherein the capacitance between the first conductor and a first portionof the second conductor is compared to the capacitance between the firstconductor and a second portion of the second conductor. However, anysuitable arrangement or geometry of the first and second conductors maybe used.

The sensor 140 may alternatively be a resistance sensor. Similar to thecapacitive sensor, the resistance sensor preferably has at least twoconductors and functions to measure the resistance in between the twoconductors. In an example, the two conductors may be placed in twodifferent locations within the cavity 125. The resistance between thetwo conductors may be of a first value in the retracted state and theresistance between the two conductors may be of a second value in theexpanded state. When a user provides a force to inwardly deform thedeformed particular region 113, the resistance between the twoconductors may be of a third value that may be in between the first andthe second value. This reading may be used to determine the occurrenceof inward deformation of the expanded particular region 113, but mayalso be used to determine the degree of inward deformation of theexpanded particular region 113 caused by the user.

The sensor 140 may alternatively be a pressure sensor. In this variationof the sensor 140, the fluid 120 is preferably of a volume thatsubstantially fills the cavity 125 and is also preferably of asubstantially incompressible fluid (e.g. water, oil), but may be of anyother volume or fluid type wherein inward deformation of the particularregion 113 will cause a measurable change in the volume of fluid 120within the cavity 125. The pressure sensor preferably measures anincrease in the pressure within cavity 125 when there is an inwarddeformation of the particular region 113. The pressure sensor ispreferably an absolute pressure sensor, but may also be a differentialpressure sensor or any other suitable type of pressure sensor. Thepressure sensor may alternatively be a strain gauge mounted within andpartially defining the cavity, which deforms when there is an inwarddeformation of the particular region 113. The pressure sensor of thesensor 140 may, however, be of any suitable type to measure pressurechange within the cavity 125 due to inward deformation of the particularregion 113.

As shown in FIG. 19b , the sensor 140 may alternatively be a flowsensor. The flow sensor preferably measures backflow of the fluid 120.In this variation, the cavity 125 is preferably coupled to a channel138. When there is inward deformation of the particular region 113, theoverall volume of the cavity 125 will decrease, forcing a volume of thefluid 120 to backflow through the channel 138. The flow sensorpreferably detects and/or measures the backflow of the fluid 120 throughthe channel 138 to determine the occurrence of a deformation of theparticular region 113 and/or the magnitude of deformation of theparticular region 113. To measure the backflow, the flow sensor ispreferably placed in a location in the channel 138 wherein fluid flow isonly seen when there is backflow due to the inward deformation of theparticular region 113. In one example, the channel 138 may also includea valve 122 that is normally closed to maintain a constant volume offluid 120 within the cavity. When there is inward deformation of theparticular region 113, the valve 122 is opened, allowing backflow to therest of the channel 138. The flow sensor may be a flow rate sensor thatmeasures the flow rate of the fluid. The volume of fluid 120 that flowsthrough the channel 138 may be calculated from the known cross sectionalarea of the channel 138 and the flow rate. For demonstration andconciseness, the valve 122 and/or sensor 140 are shown to be located inrelatively close proximity to the cavity 125 in FIG. 19b . However, thevalve 122 and/or sensor 140 may be placed in any other suitable locationrelative to the cavity 125 (for example, in a region not pictured inFIG. 19b ), that enables contact with fluid flowing through the channel138. The pressure sensor may alternatively be a Hall effect sensor orany other type of sensor that senses the opening of the valve 122 due tothe backflow of the fluid 120. However, the flow sensor may be any othertype of fluid sensor that is able to detect and/or measure backflow ofthe fluid 120.

The sensor 140 may alternatively be a strain sensor. The strain gagesensor preferably measures the strain of the particular region 113 ofthe surface 115. By knowing the nominal strain of the particular region113 of the surface 115 in the retracted volume setting and in theextended volume setting, the strain sensor identify when the particularregion of the surface has been depressed in the extended volume setting.A plurality of strain sensors may facilitate determining the location ofthe user input relative to the particular region 113. Multiple straingauges may be coupled either on, under, or within the surface, and thedifference in deformation of one portion of the surface relative toanother may help indicate the location of the user input relative to theparticular region 113.

Because the capacitive, the resistance, the pressure, the flow, and thestrain sensor variations of the sensor 140 may allow the location of auser input or a shift in the location of user input along thedeformation of the particular region 113 (e.g., as the user “sweeps”from one location to another) to be detected, the sensor 140 of thesevariation may be applied to the slide and the pointing stick variationsof the deformation of the particular region 113 described above.

The sensor 140 is preferably one of the variations described above, butmay be any other sensor suitable to sensing the inward deformation ofthe particular region 113. The sensor 140 may also be of any suitablecombination of the variations described above.

4. The Processor

The user interface system 100 of the preferred embodiment may alsoinclude a processor, which is coupled to the displacement device 130 andto the sensor 140. As shown in FIG. 20, the processor 160 functions tooperate the user interface system 100 in an Extended Cavity Mode and aRetracted Cavity Mode. In the Extended Cavity Mode when the particularregion 113 of the surface is outwardly deformed, then a force of a firstdegree or magnitude applied by the user onto the deformed particularregion of the surface 113 is preferably recognized as a user input of afirst type. A force of a second degree or magnitude applied by the useronto the deformed particular region 113 of the surface, wherein thesecond degree is less than the first degree, is preferably recognized asa user input of a second type. In an example, if the force of the seconddegree is the result of the user resting his or her finger on theparticular region 113, then the processor 160 preferably ignores theuser input of the second type. In this manner, the deformation of theparticular region 113 additionally functions to distance the user touchfrom the sensor 140 and to allow the user to rest their fingers on thedeformation (the location of an input) without actuating the input.Alternatively, if the force of the second degree is the result of theuser lightly applying force to the particular region 113, then theprocessor 160 may interpret the user input of the second type as aninput of a lower magnitude than the user input of the first type.However, any other suitable relationship between the user input of thefirst type and the second type may be applied. The determination ofwhether the force applied by the user on the particular region 113 is ofthe first degree or the second degree may be set or modified by themanufacturer, the processor, and/or the user. In the Retracted CavityMode when the particular region 113 of the surface is not outwardlydeformed, then a user touch at the particular region in the surface 115is preferably not recognized as a user input of the first type or thesecond type, but rather as a user input of a third type that isdistinguishable from a user input of the first type and the second type.The user input of the third type may also be ignored. Additionally, inthe Extended Cavity Mode, a force applied by the user of a third degree,wherein the third degree is lower than the first degree but higher thanthe second degree, may be interpreted as a user input of a fourth type.However, any additional degrees of force applied by the user on theparticular region 113 may be detected and interpreted as any suitabletype of user input.

The processor 160 may also function to detect the rate at which the userapplies a force to the particular region 160. In the Extended CavityMode when the particular region 113 of the surface is outwardlydeformed, then a force applied at a first rate of change onto thedeformed particular region of the surface 113 is preferably recognizedas a user input of a first type. An applied force of a second rate ofchange onto the deformed particular region 113 of the surface, whereinthe second rate is higher than the first rate, is preferably recognizedas a user input of a second type. For example, the inward deformation ofthe particular region 113 may be interpreted by the processor 160 as anindication of the user to scroll through a webpage. When the userapplies a force at the first rate, the processor will scroll through thewebpage at a first speed. When the user applies a force at the secondrate, then the processor will scroll through the website at a secondspeed, wherein the second speed is faster than the first speed. In thismanner, the sensor 140 and the processor 160 are able to determine alarger range of user inputs from the inward deformation of theparticular region 113. However, any other suitable relationship betweenthe user input of the first type and the second type may be applied. Thequestion of whether the force applied by the user on the particularregion 113 is of the first rate or the second rate may be set ormodified by the manufacturer, by the processor, or by the user. In theRetracted Cavity Mode when the particular region 113 of the surface isnot outwardly deformed, then a user touch at the particular region inthe surface 115 is preferably not recognized as a user input of thefirst type or the second type, but rather is recognized as a user inputof a third type that is distinguishable from a user input of the firsttype and the second type. The user input of the third type may also beignored. Additionally, in the Extended Cavity mode, a force applied bythe user of a third rate of change, wherein the third rate is higherthan the first rate but lower than the second rate, may be interpretedas a user input of a fourth type. However, any additional rate of changeof force applied by the user on the particular region 113 may bedetected and interpreted as any suitable type of user input.

The processor 160 may also function to automatically alter the settingsof the user interface system 100. In a first example, in extremely lowtemperatures, it may be impossible for the displacement device 130 tomodify the volume of the fluid to expand the cavity 125 and deform theparticular region 113. The processor 160 may be coupled to a temperaturesensor and may disable the displacement device 130 under suchconditions. In a second example, in high altitude conditions (or in anairplane with reduced air pressure), it may be impossible for thedisplacement device 130 to modify the volume of the fluid to retract thecavity 125. The processor 160 may be coupled to a pressure sensor andmay either disable the displacement device 130, or may simply adjust thevolume of the fluid that is modified under such conditions.

As shown in FIG. 21, the processor 160 may also be coupled to thedisplay 150 such that different input graphics may be displayed underthe particular region 113, and different inputs may be recognized. As anexample, when the cavity 125 is in the Extended Cavity Mode, the display150 may include an input graphic of a first type (such as a letter) andthe user input on the deformation would be of a first type (such as aletter), and the display 150 may include an input graphic of a secondtype (such as a number) and the user input on the deformation would beof a second type (such as a number). When the cavity 125 is in theRetracted Cavity Mode, the display 150 may further include an inputgraphic of a third type (such as an “enter” or “accept” input), and theuser input on the sensor 140 would be of a third type (such as an“enter” or “accept” input). The processor 160 may also be coupled to thedevice upon which the display 150 and the user interface system 100 areused and may function to control processes carried out by the device.

The processor 160 may also function to alter the output of the display150 to correct or adjust for any optical distortion caused by thedeformation of the particular region 113. It is envisioned that, incertain applications, the size of the deformation may cause a “fish eye”effect when viewing the display 150. The processor, preferably throughempirical data, may adjust the output to help correct for thisdistortion.

The processor 160 preferably includes a separate and remote controllerfor the displacement device 130, a separate and remote controller forthe sensor 140, and a separate and remote controller for the display150. The processor 160 may, however, integrally include a controller forone or more of these elements.

The processor 160 preferably performs one of the functions describedabove, but may also perform any combination of the functions describedabove or any other suitable function.

5. Second Cavity

As shown in FIG. 1, the user interface system 100 of the preferredembodiment also includes a second cavity 125. The additional cavitiesmay be substantially identical to the cavity 125, but may also bedifferent in construction, geometry, size, and/or any other suitablefeature. Each of the plurality of cavities 125 are preferably able tooutwardly deform independently from each other, allowing the userinterface system 100 to be adapted to a variety of user input scenarios.Alternatively, the plurality of cavities 125 may be grouped into aplurality of portions, wherein the cavities 125 within one group willoutwardly deform together. This may be applied to scenarios wherein agroup of cavities 125 are assigned to a particular user input scenario,for example, as a dial pad on a mobile phone or as a QWERTY keyboard.The processor 160 preferably selectively controls the outwarddeformation of the particular region 113 of each cavity 125. However,any other suitable method of controlling the cavities 125 may be used.

The processor 160 preferably also selectively receives and/or interpretssignals representing the presence of a force applied by a user to anycavity 125. The sensor 140 for each cavity 125 is preferably arranged inan array network that preferably communicates the location of eachsensor 140 to the processor 160 to allow the processor 160 toselectively receive and/or interpret signals coming from each cavity125. In the variation of the sensor 140 as a capacitive sensor, as shownin FIGS. 22 and 23, the array includes a first number of X-conductors142 and a second number of Y-conductors 144. In a first variation, asshown in FIG. 22, the first number of X-conductors 142 is preferablyequivalent to the number of cavities 125, wherein each X-first conductor142 corresponds to one cavity 125, and the second number of Y-conductors144 is preferably equivalent to the number of columns of cavities 125,wherein each Y-conductor 144 corresponds to all the cavities 125 withinone column of cavities 125. In this first variation, the location of auser touch is preferably determined by detecting a change in themeasured capacitance value between one X-first conductor 142 and thecorresponding Y-conductor 144 for a particular cavity 125. Because eachcavity 125 is associated with one X-first conductor 142, the processor160 is able to detect the location of the cavity 125 over which the userhad applied a force. In a second variation, as shown in FIG. 23, thefirst number of X-conductors 142 is preferably equivalent to the numberof rows of cavities 125, wherein each X-first conductor 142 correspondsto all the cavities 125 within one row of cavities 125, and the secondnumber of Y-conductors 144 is preferably equivalent to the number ofcolumns of cavities 113, wherein each Y-conductor 144 corresponds to allthe cavities 113 within one column of cavities 144. In this secondvariation, the location of a user touch is preferably determined bydetecting a change in the measured capacitance value between one X-firstconductor 142 and one Y-conductor 144. Because each cavity 125corresponds to a different intersection of the X-conductors 142 and theY-conductors 144, the processor 160 is able to detect the location ofthe cavity 125 over which the user had applied force. In a thirdvariation, the first number of X-conductors 142 and the second number ofY-conductors 144 are both preferably equivalent to the number ofcavities 125, one X-first conductor 142 and one Y-conductor 144correspond to one cavity 125. In this third variation, the location of auser touch is preferably determined by detecting a change in themeasured capacitance value between one X-first conductor 142 and oneY-conductor 144. Because each cavity 125 corresponds to a different pairof the X-conductors 142 and the Y-conductors 144, the processor 160 isable to detect the location of the cavity 125 over which the user hadapplied force.

Alternatively, the array network of sensors 140 may include a pluralityof sensors 140, each coupled to a cavity 125, that each output a signalspecific to the cavity 125. For example, in the capacitive sensorvariation of the sensor 140, the sensor 140 for a first cavity 125 maysend a signal of 0.5 nF when a user input is detected and a signal of 1nF when no user input is detected, the sensor 140 for a second cavity125 may send a signal of 5 nF when a user input is detected and a signalof 10 nF when no user input is detected, the sensor 140 for a thirdcavity 125 may send a signal of 50 nF when a user input is detected anda signal of 100 nF when no user input is detected, and the sensor 140for a fourth cavity 125 may send a signal of 500 nF when a user input isdetected and a signal of 1000 nF when no user input is detected. Becauseeach cavity 125 sends a different signal, the processor 160 is able todetect the location of the user input based upon the type and/or valueof the signal that is received from the sensors 140. The plurality ofsensors 140 for the cavities 125 may also be arranged in a parallelrelationship (such that the overall capacitive value for a plurality ofcapacitors in parallel equate to the sum of the individual capacitivevalues) to facilitate the processor 160 in sensing the location of theuser input. For example, using the aforementioned example values for thesignals from the sensors 140 of a first, second, third, and fourthcavities 140, the processor 160 may receive a combined signal of 555.5nF from the sensors 140 when a user input is detected from all of thefirst, second, third, and fourth cavities 125 and a signal of 1111 nFfrom the sensors 140 when no user input is detected from any of thefirst, second, third, and fourth cavities 125. When a user input isdetected from the third cavity 125 and not from the first, second, andfourth cavities 125, then the combined signal to the processor 160 maybe 1061 nF. Similarly, when a user input is detected from both thesecond and third cavities 125, then the combined signal to the processor160 may be 1056 nF. The processor 160 is then able to interpret thelocations of the user input directly from the value of the signal thatis received from a plurality of sensors 140 of the cavities 125,simplifying electrical routing, mechanical components, and programmingin the user interface system 100. The sensors 140 may also be arrangedin series or in any other suitable electrical arrangement.

The array arrangements described above also provide the advantage ofutilizing multiple sensors 140 to more accurately locate the presence ofa user input. User input onto a first expanded particular region 113 mayaffect the sensor 140 readings for a second expanded particular region113. By collectively analyzing readings from multiple sensors 140, theparticular region 113 upon which the user provides an input may be moreaccurately determined. For example, in the variation wherein the sensor140 is a pressure sensor, the pressure sensed by other sensors 140within the system may be increased when a user provides input at a firstparticular region 113. By sensing the increase of pressure sensed bysensors 140 adjacent to a particular region 113, the location of theuser input may be more accurately determined. Additionally, the arrayarrangements described above allows for multiple inputs provided at asingle time to be detected by the system.

The sensors 140 are preferably located within the cavities 125, but mayalternatively be located adjacent to the cavities 125 or both within andadjacent to the cavities 125. By placing sensors 140 both within andadjacent to the cavities 125, user inputs provided to locations otherthan the particular regions 113 may also be detected, expanding therange of input types and query types for the device. Sensors 140 placedadjacent to the cavities 125 may also be used to more accurately locatethe particular region 113 upon which the user provided the input.

The sensor 140, cavity 140, and second cavity 140 may are preferably inarranged in one of the variations described above, but may also be anycombination of the variations described above. However, any othersuitable arrangement or method of controlling the cavities 125 may beused.

6. Power Source

The user interface system 100 of the preferred embodiments may alsoinclude either a power source or a power harnessing device, which bothfunction to power the displacement device 130 (and possibly otherelements of the user interface system, such as the sensor 140 and/or thedisplay 150). The power source is preferably a conventional battery, butmay be any suitable device or method that provides power to thedisplacement device 130. The power-harnessing device, which ispreferably integrated into the hinge of a flip phone or laptop,functions to harness a portion of the energy involved in the normal useof the electronic device (such as the physical energy provided by theuser in the opening of a flip phone or the screen on a laptop). Thepower-harnessing device may alternatively be integrated in a separatemechanical input device (such as a button on the side of a mobile phone,or a “self-winding” device found in automatic watches) or any othersuitable device or method to harness a portion of the energy involved inthe normal use of the electronic device.

As a person skilled in the art will recognize from the previous detaileddescription and from the figures and claims, modifications and changescan be made to the preferred embodiments of the invention withoutdeparting from the scope of this invention defined in the followingclaims.

We claim:
 1. A user interface comprising: a layer defining a tactilesurface and comprising a first region and a particular region adjacentthe first region; a substrate defining a fluid channel, cooperating withthe layer at the particular region to define a cavity fluidly coupled tothe fluid channel, coupled to the layer at the first region, anddisconnected from the layer at the particular region; a displacementdevice displacing fluid into the fluid channel into the cavity totransition the particular region from a retracted volume setting into anexpanded volume setting, the particular region substantially level withthe first region in the retracted volume setting and elevated above thefirst region in the expanded volume setting; a sensor comprising a firstconductor and a second conductor coupled to the substrate and adjacentthe cavity, the first conductor offset from the second conductor andcapacitively coupled to the second conductor; a processor coupled to thesensor, detecting a change from a first capacitance to a secondcapacitance between the first conductor and the second conductor todetermine a transition of the particular region from the retractedvolume setting to the expanded volume setting, and detecting a changefrom the second capacitance to a third capacitance between the firstconductor and the second conductor with an input on the particularregion in the expanded volume setting.
 2. The user interface of claim 1,wherein the processor determines the first capacitance between the firstconductor and the second conductor with a first height of fluid withinthe cavity corresponding to the retracted volume setting; and whereinthe processor determines the second capacitance between the firstconductor and the second conductor with a second height of fluid withinthe cavity corresponding to the expanded volume setting, the secondheight greater than the first height.
 3. The user interface of claim 2,wherein the processor determines the third capacitance between the firstconductor and the second conductor with a third height of fluid withinthe cavity, the third height greater than the first height and less thanthe second height; and wherein the processor determines a transitionfrom the second height to the third height with an input on theparticular region in the expanded volume setting.
 4. The user interfaceof claim 1, wherein the first conductor is adjacent a first side of thecavity; wherein the second conductor is arranged on a second side of thecavity substantially opposite the first side of the cavity; and whereinthe first conductor and the second conductor cooperate to generate anelectric field across a portion of the cavity.
 5. The user interface ofclaim 1, wherein the first conductor is coupled to the tactile layerproximal the particular region; wherein a portion of the second regionis arranged within the cavity; wherein the first conductor is offsetfrom the second conductor by a first distance in the retracted volumesetting; and wherein the first conductor is offset from the secondconductor by a second distance greater than the first distance in theexpanded volume setting.
 6. The user interface of claim 1, wherein theprocessor interprets a first rate of a change from the secondcapacitance to the third capacitance between the first conductor and thesecond conductor with an input of a first type on the particular region;and wherein the processor interprets a second rate of a change from thesecond capacitance to the third capacitance between the first conductorand the second conductor with an input of a second type on theparticular region, the second rate of a change different from the firstrate of a change.
 7. The user interface of claim 1, further comprising areservoir containing fluid; wherein the displacement device displacesfluid from the reservoir into the fluid channel to transition theparticular region from the retracted volume setting into the expandedvolume setting; and wherein the displacement device displaces fluid fromthe fluid channel into the reservoir to transition the particular regionfrom the expanded volume setting into the retracted volume setting. 8.The user interface of claim 1, further comprising a display coupled tothe substrate and rendering a visual image through the substrate;wherein the tactile layer comprises a substantially transparentmaterial; wherein the substrate comprises a substantially transparentmaterial; and wherein the volume of fluid comprises a substantiallytransparent material.
 9. The user interface of claim 8, wherein thedisplay renders the visual image corresponding to a virtual key proximalthe particular region.
 10. The user interface of claim 1: wherein theparticular region defines a first tactile formation over the firstregion in the expanded volume setting; wherein the layer comprises asecond particular region adjacent the first region; wherein thesubstrate defines a second fluid channel, cooperates with the layer atthe second particular region to define a second cavity fluidly coupledto the second fluid channel, and disconnected from the layer at thesecond particular region; and wherein the displacement device displacesfluid into the second fluid channel toward the second cavity totransition the second particular region from the retracted volumesetting into the expanded volume setting, the second particular regionsubstantially level with the first region in the retracted volumesetting and elevated above the first region in the expanded volumesetting, the second particular region defining a second tactileformation over the first region in the expanded volume setting, thesecond tactile formation distinct from the first tactile formation. 11.The user interface of claim 10, wherein the displacement deviceselectively transitions the particular region and the second particularregion between the retracted volume setting and the expanded volumesetting.
 12. The user interface of claim 1, wherein the first conductoris arranged within the substrate at a first depth relative to a base ofthe cavity; and wherein the second conductor is arranged within thesubstrate at a second depth relative to the base of the cavity greaterthan the first depth.
 13. The user interface of claim 1, wherein theparticular region defines a slider across the tactile surface in theexpanded volume setting.
 14. The user interface of claim 13, wherein thesensor comprises a third conductor coupled to the substrate, offset fromthe second conductor along the slider, and capacitively coupled to thesecond conductor; wherein the processor determines a location of aninput on the tactile surface proximal the slider based on a change incapacitance between the first conductor and the second conductor over aduration of time and a change in capacitance between the secondconductor and the third conductor over the duration of time.
 15. A userinterface comprising: a layer defining a tactile surface and comprisinga first region and a particular region adjacent the first region; asubstrate defining a fluid channel, cooperating with the layer at theparticular region to define a cavity fluidly coupled to the fluidchannel, coupled to the layer at the first region, and disconnected fromthe layer at the particular region; a displacement device displacingfluid into the fluid channel toward the cavity to transition theparticular region from a retracted volume setting into an expandedvolume setting, the particular region substantially level with the firstregion in the retracted volume setting and elevated above the firstregion in the expanded volume setting; a sensor comprising a firstconductor and a second conductor coupled to the substrate and adjacentthe cavity, the first conductor offset from the second conductor andcapacitively coupled to the second conductor; a processor sampling thesensor, detecting a first capacitance between the first conductor andthe second conductor with a first height of fluid within the cavitycorresponding to the retracted volume setting, and detecting a secondcapacitance between the first conductor and the second conductor with asecond height of fluid within the cavity corresponding to the expandedvolume setting.
 16. The user interface of claim 15, wherein theprocessor detects an input on the tactile surface at the deformableregion based on a change in capacitance between the first conductor andthe second conductor.
 17. The user interface of claim 16, wherein theprocessor interprets a first rate of change in capacitance between thefirst conductor and the second conductor with an input of a first typeon the tactile surface at the particular region; and wherein theprocessor interprets a second rate of change in capacitance between thefirst conductor and the second conductor with an input of a second typeon the tactile surface at particular region, the second rate of a changedifferent from the first rate of a change.
 18. The user interface ofclaim 15, wherein the first conductor is coupled to the tactile layerproximal the particular region; wherein a portion of the second regionis arranged within the cavity; wherein the first conductor is offsetfrom the second conductor by a first distance in the retracted volumesetting; and wherein the first conductor is offset from the secondconductor by a second distance greater than the first distance in theexpanded volume setting.